BRFP: An Efficient and Universal Sentence Embedding Learning Model Method Supporting Fused Syntax Combined with Graph Embedding Representation Algorithm

نویسندگان

چکیده

Due to the rapidly growing volume of data on Internet, methods efficiently and accurately processing massive text information have been focus research. In natural language theory, sentence embedding representation is an important method. This paper proposes a new learning model called BRFP (Factorization Process with Bidirectional Restraints) that fuses syntactic information, uses matrix decomposition learn calculates word vectors obtain embedded sentences. experimental chapter, similarity experiments are conducted verify rationality effectiveness analyzed results Chinese English texts current mainstream methods, potential improvement directions summarized. The datasets, including STS, AFQMC, LCQMC, show proposed in this outperforms CNN method terms accuracy F1 value by 7.6% 4.8. comparison experiment vector weighted shows when length longer, or corresponding structure complex, model’s advantages more prominent than TF-IDF SIF methods. Compared method, effect improved 14.4%. it has maximum advantage 7.9%, overall each comparative task between 4 6 percentage points. neural network experiment, compared CNN, RNN, LSTM, ST, QT, InferSent models, significantly 14’OnWN, 14’Tweet-news, 15’Ans.-forum datasets. For example, 14’OnWN dataset, 10.9% over ST 14’Tweet-news dataset 22.9% LSTM 24.07% RNN article also demonstrates generality model, proving universal framework.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Learning Graph Representations with Embedding Propagation

Label Representations • Let l ∈ Rd be the representation of label l, and f be a differentiable embedding function • For labels of label type i, we apply a learnable embedding function l = fi(l) • hi(v) is the embedding of label type i for vertex v: hi(v) = gi ({l | l ∈ labels of type i associated with vertex v}) • h̃i(v) is the reconstruction of the embedding of label type i for vertex v: h̃i(v) ...

متن کامل

Active Learning for Graph Embedding

Graph embedding provides an ecient solution for graph analysis by converting the graph into a low-dimensional space which preserves the structure information. In contrast to the graph structure data, the i.i.d. node embeddings can be processed eciently in terms of both time and space. Current semi-supervised graph embedding algorithms assume the labelled nodes are given, which may not be alwa...

متن کامل

Graph Embedding with Constraints

Recently graph based dimensionality reduction has received a lot of interests in many fields of information processing. Central to it is a graph structure which models the geometrical and discriminant structure of the data manifold. When label information is available, it is usually incorporated into the graph structure by modifying the weights between data points. In this paper, we propose a n...

متن کامل

Graph Embedding

Some of the parameters used to analyze the efficiency of an embedding are dilation, expansion, edge congestion and wirelength. If e = (u, v) ∈E (G), then the length of Pf (e) in H is called the dilation of the edge e. The maximal dilation over all edges of G is called the dilation of the embedding f. The dilation of embedding G into H is the minimum dilation taken over all embeddings f of G int...

متن کامل

An improved and efficient stenographic scheme based on matrix embedding using BCH syndrome coding.

This paper presents a new stenographic scheme based on matrix embedding using BCH syndrome coding. The proposed method embeds massage into cover by changing some coefficients of cover. In this paper defining a number :::as char:::acteristic of the syndrome, which is invariant with respect to the cyclic shift, we  propose a new embedding algorithm base on BCH  syndrome coding, without finding ro...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Journal of Sensors

سال: 2022

ISSN: ['1687-725X', '1687-7268']

DOI: https://doi.org/10.1155/2022/7471408